Research Article
Jaitip Nasongkhla, Chich-Jen Shieh
CONT ED TECHNOLOGY, Volume 17, Issue 4, Article No: ep603
ABSTRACT
This study examines the effect of robot-assisted problem-based learning (PBL) on learning outcomes in higher education. A quasi-experimental design was adopted, and the application was carried out over 16 weeks (48 hours) with two parallel branches. In the experimental group, a question-and-answer-focused educational robot was integrated into the project-based learning process, while in the control group, the same content was applied without robots. Measurements encompassed self-directed learning (including self-management), problem-solving, and comprehension/discovery dimensions. Bayesian comparisons showed that the level of evidence in favor of the experiment was in the medium-strong range for most variables; a significant increase was observed particularly in self-management. Problem-solving and comprehension/discovery scores were also higher in the experimental condition. Figures and tables report posterior effect sizes and 95% confidence intervals. The results indicate that robot-assisted PBL, which offers timely and elucidative feedback, improves the metacognitive processes associated with PBL and aids students in adhering to their study goals more consistently. In conclusion, robot-assisted PBL can significantly improve self-management, problem-solving, and comprehension outcomes, provided that appropriate feedback design and application fidelity are maintained. Future research should examine its effects across various fields by integrating long-term follow-up periods and behavioral performance assessments. The study enhances the reproducibility of results by evaluating the strength of evidence through open Bayesian reporting. This method makes design choices more transparent and establishes clear guidelines on how educational technologies should be used responsibly.
Keywords: problem-based learning, AI robots, blended learning, learning outcomes, self-directed learning
Research Article
Abbas Bodaubekov, Shakhrizat Agaidarova, Talgat Zhussipbek, Davronzhon Gaipov, Nuri Balta
CONT ED TECHNOLOGY, Volume 17, Issue 1, Article No: ep548
ABSTRACT
This study investigates the effectiveness of feedback provided by teachers versus feedback generated by the Write & Improve platform in enhancing the writing skills of senior undergraduate students enrolled in a “two foreign language” program at a private university in Kazakhstan. The quasi-experimental design involved four teachers, each teaching one control and one experimental class, totaling eight groups of students. Pre- and post-tests were conducted over a period of five weeks, focusing on task achievement, coherence and cohesion, lexical resource, grammar and accuracy, and overall score. Data analysis included descriptive statistics, Mann-Whitney U tests for pre-test comparisons, and MANCOVA analyses for post-test comparisons. Results show no significant difference in the impact of Write & Improve feedback compared to traditional teacher feedback across multiple dimensions of the writing test, both within individual teachers’ classes and when combined. Longitudinal analysis reveals fluctuating scores over time with no consistent improvement. Thus, the study concludes that the Write & Improve tool is equally effective as teacher feedback in improving students’ writing skills. This implies that educational institutions can potentially integrate technology-based feedback systems like Write & Improve alongside traditional teaching methods to enhance student learning outcomes in writing proficiency.
Keywords: AI feedback, English language, student learning outcomes, teacher feedback, Write & Improve tool
Research Article
Katherina Gallardo, Leonardo Glasserman, Nohemi Rivera, Lizette Martínez-Cardiel
CONT ED TECHNOLOGY, Volume 15, Issue 2, Article No: ep415
ABSTRACT
A mixed-method study about the perception of students and faculty around learning assessment practices was conducted in a multicampus competency-based approached Mexican private university. The objective was getting new knowledge about higher education community perception around learning assessment practices, learning outcomes production and how authentic assessment was driven while working on different modalities during the pandemic: remote learning, synchronous hybrid learning, alternate hybrid learning, and on-site modality. A questionnaire, and an interview for faculty and focus groups for students were designed, validated, and conducted. A total of 281 faculty and 908 students participated in this study. The main quantitative results indicate that students who took on-site classes evaluate the variables better than those who took hybrid classes. In addition, students who took remote classes evaluate the authenticity variable better than those who took it in alternate hybrid modality. In the case of the faculty, only the equality variable showed significant differences between the reported modalities. Besides, the main qualitative results indicate that perceptions are quite different between faculty and students while getting their perceptions from an evaluation standards scope. Thus, their perspectives around equality, authenticity, feasibility, reliability and ethics were obtained and discussed against literature. The main conclusions of the study remarked that students and faculty were positive towards most of the execution of learning assessment and learning outcomes practices during the pandemic. Nevertheless, students’ preference of on-site modality was determined as the way they have more opportunities for interacting and learning more from assessment and feedback.
Keywords: innovation in education, competency-based education, higher education, learning outcomes, performance assessment